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ABoLRACT 


A statistical method is evaluated to determine its 
accuracy for estimating lower confidence bounds on system 
reliability of a mixture of missile configurations using 
component data. Monte Carlo simulations are used to 


establish the accuracy of these bounds. 





TABLE OF CONTENTS 


om 


ts INTRODUCTION ------------------- - -------- ------ 7 
a. MODIFIED LOG-GAMMA METHOD ----------------------- 8 
IIIT. EVALUATION PROCEDURE -------3- 3-37-93 ----------- iS 

A. ZERO FAILURE VS ONE FAILURE CASE ------------ 15 

B. SIMULATION RESULTS -------------------~------- 19 
ey, CONCLUSIONS ------- 7-3 rr 35 
APPENDIX A: PROGRAM VARIABLE DEFINITIONS ------------- 36 
APPENDIX B: COMPUTER PROGRAM LISTING ---------3-------- 39 
BIBLIOGRAPHY -------------------------- -- - -- -- - - -- - -- -- 45 
INITIAL DISTRIBUTION LIST ---------------------=------- 16 





Oe 


LIST OF STABLES 


eee 0) mea < nS = se — Se — 16 
ee eee) ae ------ ale? 
ACCURACY OF R(l-a) AS A 100(1l-a)% LOWER 
CONFIDENCE LIMIT FOR RS (CORRECTION TERM 

EQUAL TO 2.25) ----<<9--<--------------------- 2s 
ACCURACY OF R(l-a) AS A 100(1l-a)% LOWER 
CONFIDENCE LIMIT FOR RS (CORRECTION TERM 

Pee ee tOnon0, DEe 0) e———-——— = en 27 
ACCURACY OF R(l-a) AS A 100(1l-a)% LOWER 
CONFIDENCE LIMIT FOR RS (CORRECTION TERM 

eee Can DEO) —————— 31 





iP eee RO UET LON 


A statistical method has been proposed which obtains 
a lower confidence bound on system reliability. It isa 
modified log-gamma procedure developed to measure fleet 
missile system reliability. Monte Carlo simulations were 
performed to evaluate its accuracy as an estimate for 
system reliability. Five hundred simulations were run for 
each of twelve cases examined at 80% and 90% confidence 
levels. The results of these simulations are included in 
this paper. Additional simulations were performed with minor 
modifications to the proposed log-gamma method. These changes 
are documented and the results are included. A comparison 
was made between the two versions on their accuracy for 
estimating the lower confidence bound on system reliability. 

The reliability equations were applied to a hypothetical 
fleet missile system configuration and analyzed for changes 
in test sample sizes,., Component reliabilities and weighting 
factors. The proposed procedure was determined to be 
Significantly inaccurate for small and large amounts of 
accumulated test data on missile components. It also has 
the distracting defect that larger lower confidence bounds 
are obtained from data sets with one failure than those 


obtained from data sets with zero failures. 











People tay LOG=-GAMMA METHOD 


The log-gamma method, in its more general form, can 
apply to nonseries as well as to fleet-mixture populations. 
The underlying theory is contained in [Ref. 1]. Examples 
of cases where it is suspect have been included in the 
following chapter. The procedure below describes the 
proposed modified log-gamma method as it 1s applied to a 
series system. 

Assume that in a series system there are k components 
each with a sample size ny where 1=1, 2, ..., k. Let 
the number of failures be f. BGtbwiy = sieeel, s2., kK. Consider 
first the case when there is at least one failure in the 
system. Thus rf. SO, 


Let 
re tr. 
=e (2s) 


be the point estimates of the i-th component reliability. 


Then the equation 


1s the point estimate of the system reliability. Define 


IAs 
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il 


R 





and 


mn 7 k 1 
vae= (l —=R) , = (224) 
: eae 
5 1 oat 
Vis used aS an estimate of the variance of -ln R. It is 


“wn 


assumed that the distribution of -ln R can be approximated 


by a gamma distribution as follows 


L-l1 .Lz/lin R 
Z e 


f(z) = a | UCU! (COS 2s) ) 
= lige 18: 
aan 
& -IlIn R 
where Zz = - ln R and L and a are parameters. 
fet 
(-ln ye 
L*¥ = = Zee a) 
V 
and 
hee ee 22 (27) 


L* is the method-of-moments estimate of the shape parameter. 
A constant term 2.25 is added to L*, the shape parameter 
estimate in the proposed modified log-gamma procedure. The 
lower (1-a) confidence bound, R(1l-«a) is given by solving 
the equation 


sae 
2 oe) Fl) 
Pee) eas ae | 


where oy - is the lower a-quantity of the chi-square 


distribution with 2L degrees of freedom. Interpolation is 


required if 2L is noninteger. 











If there are zero failures in the system () E ie), 


let 


N*¥ = — (-2)..9.) 
a 
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where N* is defined to be the effective sample size. Then 
Pmewlewere sh — o& Confidence bound R({l1-a) is computed according 
to a binomial confidence bound based on zero failures out of 
Peer lals (1.e., R(l-a) = Tey Pelee 96s nonlnteger 
then linear interpolation 1s recommended in the proposed 
procedure but it 1s not necessary because the same formula 
could be used for N* an integer. 

The modified log-gamma method has been described here 
for both zero failures and one or more failures in series. 
The more general form of this method was applied to an actual 
missile system configuration to determine the lower confi- 
dence bounds. The program used to evaluate its accuracy 
has been included in Appendix B. The complete listing and 
definitions of the variables used in the program are listed 
in Appendix A. A description of the more generalized method 
1s described as it was applied to the specific missile 
system simulated. 

In the fleet missile system examined there were different 
groups of missiles with different configurations. The 


population was therefore not homogeneous and weights were 


10 








asSigned to the different groups. There were 14 components 
in the system modeled and eight mixture weights for the 
subgroups. The input data consisted of f. (the number of 
failures in the i-th component), n. (the sample size for 
the i-th component), M. (the exponent of each component) 
and c (the weights applied to each subgroup). Point 


estimates for this system were defined as follows 


M f 
2 (De aay 
al YT). 
=i lk 
- 5 M. 
Pp = o. R; (2a) 
: 10 a 
a = oe R. (eae?) 


with the subgroup reliability point estimates being 
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The variance of -ln R is then estimated by V given by 


equation (2.15) 


where S.. 
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the following equations. 


and 
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The estimates Si5 are found by solving 
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Then the Pas = are solved by the equations listed in the 


program in Appendix B and repeated below. 


ei{i,1) = 
ey, 2) = 
a3,3) = 
a4) = 
$(5,5) = 
enicro) = 
S(7,7) = 
Bie, 8) = 
scl,2) = 
eee, 3) = 
exe, 4) = 
eS) = 
Eaelo) = 
S (U5) a 
Sa 73) = 
B2,3) = 
eu2,4) = 


S$(2,5) = 


Finally, 


Ya ial 
Ue a 
pe ae 
une 13 
wR 3 
iy 33 
ee 1 
Vi Gia 
al + V 
VR 

0 

eee a5 
wi 

Vp ap Vaal 
“al 

0 

Oy 

tay 


NO 


S§(2,6) = V.. + V 


Hae Ne ie 

+ Vi2 S27) = Vii 

+ Vig S (2,8) = Vig + Via 

+ Via $(3,4) = V13 + Va4 

or Vi2 Si375) = Ve + Vi3 

+ V1 > S (3,0) = Vi3 

+ Vig Soy) = ae Ue 

+ Vig Sy (0S) pte) Vig 
S$(4,5) = Vi3 
S$(4,6) = Vy + V7.3 2 
S$(4,7) = Via 
S(4,8) = Vy t V4 
S (576) = V3 + Vi2 
Si577) = We 
S5,6)= 0 
So, 7) = 0 
S(6,8) = Vv, 
Sy, o)9 = Vii B Vag 

(= iia R) 2 

L = + 2.25 (2522) 


1 


a2 le) 





and DF, 


Thus 


the degrees of freedom, is equal to 


14 
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i Vie Ee VALUATEONSPROCEDURE 


The equation for system reliability is 


L k M. 
R = aware il’ p (ar 1) 
: j=l J f= = 
where 
L = number of subsystems 
a = the weighting factor of the j-th subsystem 
k = the number of components 
<= the reliability of the i-th component 

M. = the exponent of the i-th component 


The computer program modeled a system that had 8 sub- 
systems and 14 components. System reliability (RS) was 
determined for each case and a lower confidence bound for a = .l 
and a = .2 was computed. Random numbers were drawn from a 
shuffled random number generator [Ref. 3]. Inverse chi-square 
values were determined using the international mathematical 
and statistical library (IMSL) routine called MDCHI. All 
computations were done in Single precision arithmetic, coded 


in FORTRAN, using an IBM 360 computer. 


A. ZERO FAILURE VS ONE FAILURE CASE 
An examination of two cases revealed a shortcoming and 
a motivation for evaluating the modified log-gamma procedure. 


These two examples are considered below. 


ILS 





Example l. 

Let k, the number of components in the system, be 14 
and let Roy the component reliabilities, all equal .99. 
The sample sizes (mission trials) and failures for each 
component are listed in Table I. The lower 90% confidence 


limit on system reliability is desired. 


Table I 
Component 
Wee eo mso Oo. 7 3s 9 TO J) 12° 13 


M.: # mission trials 10 10 10 10500 10 10 10 10500 10 10 10 


f.: # failures eer Oo 0s 0 0 0 OO 0 9 


When the Lf. = 0 the modified log-gamma procedure defines 


N*, the effective sample size, as 


N* = ee (3.2) 


For the data given in the table above N* is equal to 11.628. 
For this procedure the lower l-a confidence bound R(l-a) is 
computed according to a binomial confidence bound based on 
zero failures out of N* trials. The value obtained for 


Eo ce) was .820. 
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Example 2. 
Let sample sizes and f. (failures for each component) 
be given in Table II. Again the lower 90% confidence limit 


on system reliability is desired. 


Table II 
Component 
iL 2 3 4 5 6 7 8 9 EO rieer2, 13 14 


M.: # mission trials 10 10 10 10500 10 10 10 10500 10 10 10 10 


fi: # failures tee One 0 0 OF 0 OO OO 


When ut. * 0 the modified log-gamma method solves for 


ieee) urne bower contidence bound) by the following procedure. 


Let 
nw fs 
R. — Je Fade ee om f 
au Nn. 
1 
Re = .998 , oe) 
R, = Wi scenes Wie = 


be the point estimate of the i-th component reliability. 


Then 


m k 
eS TT R. = .998 jon) 


Ly, 





is the point estimate for system reliability. Define 


mR = #/K = 99986 os 
ye a k 1 
V = (1-R) , —— = 92000172 (3.6) 
: EP. 
ee 
where V estimates the variance of -ln R. 
Let 
(-ln R) 2 
i = ~ - 02828 (3.7) 
V 
and define 
eee — eee > — 2.27328 (3.8) 


where 2.25 is the correction term and L* is the method-of- 
moments estimate of the shape parameter. Then the lower 


foe cOnuraence bound, R(l-a) is computed by solving 


where Ge is the lower a quantity of the chi-square 
distribution with 2L degrees of freedom. In example 2 R(1-«a) 
1s equal to .993 

These two examples have shown the shortcoming of this 
method. The lower confidence bound for one failures is higher 


than the lower confidence bound for zero failures. 


iz:) 





B. SIMULATION RESULTS 

The lower confidence bound values obtained for the twelve 
cases studied have been listed in Table III. RS is the system 
reliability, ACV is the actual confidence value computed by 
the modified log-gamma method and R(1l-a)*500 is the percentile 
Pewesen the S00 ordered R(l-a) estimates for a = .1 and 
a= .2. N(I), RI(I) and W(I) are the respective sample sizes, 
reliabilities and weights assigned to each case. 

For example, in case number 3 the number of components 
k, 1S equal to 14 with the sample sizes equal to 50. for 
meer Or £0 and 250 for i= 5 or 10. The reliabilities of 
each component is .99 and the 8 weights are all equal to 


.125. System reliability, R., was computed to be .816 and 


5 
for a = .1 the 450-th value in the ordered 500 LCL estimates 
was .895. The Ro value of .816 was the 35th of the 500 
ordered LCL estimates yielding an actual confidence level of 
7.8%. Likewise for a = .2 the 400-th value in the ordered 
500 LCL estimates was .898. The Ro value of .816 was the 
13-th of the 500 ordered LCL estimates yielding an actual 
confidence level of 2.8%. In only one case (case 8) did the 
actual confidence value approach that of the system reliability 
as a lower bound. 

An examination of the MLG (modified log-gamma) procedure 
questioned the inclusion of the correction term 2.25. Addi- 


tional simulations were run on the same twelve cases when this 


correction term was removed and the degrees of freedom bouncec 


IU 





below by 1.0. The results obtained from this modification, 
while an improvement, were still far from providing accurate 
lower bounds on the system. The values determined from these 
runsa_re listed in Table IV. ACV values of 100% indicate that 
the system reliability was greater than all 500 estimates. 

It would appear that in order to generate more estimates 
less than RS the exponent, 2L/x57 needs to take on larger 
values. Adding a constant term such as 2.25 yields more values 
For R(l-a) that are greater than RS. Indeed, Tables III and 
IV did show this to be the case. As the exponent becomes 
larger (the chi-squared value smaller) the confidence level 
decreases. The estimate for L used in generating the values 
listed in Table IV seem more accurate when used in the 
modified log-gamma procedure. 

This modification still left much room for improvement. 

A closer reivew of the MLG method pointed to the estimate of 
the shape parameter as a possible cause of the extreme results. 
Since Z = -ln R its distribution was approximated by a two- 


parameter gamma distribution. Then 


bo tegeZ 7 im R 
Z e 








£(Z) =O re = 0 (32k) 
ie = 
(~2B A)” (Ly) 
ae 
where L and (- 7 ) are the parameters. Then 
E(z) = b+ 2B 2 -inr (ea 
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and 


2 
a “hen 2. 9 lneR 
Var(z) = L(——) ca a (3-2) 2 ) 
Note: 
Z 2 
_ in*R = mlEtz) 
BS Vem pene Var (Zz) (3.13) 
The proposed estimator L for L is 
Rn 72 
lie = > (3.14) 
Var (z) 
[E(2z)]* ~ tea) 1? 
Since L = ean it would appear that L = ——_ would 
elu vartz) 
be a better estimator for L. Since 
[E(z)]* ~ EB (2°) = Vai (2) 
we have 
4S A 
a E(z ) - Var(z) 
b= —vattz) ceil 
and since 2° is unbiased for ea we get 
2 A 2 
2 is Wishes (4) aan Z al (3.16) 
— mica. = ° 
Var(z) eee) 


Pa 





Note that this is a departure from L, in the proposed 


1 
method. Thus the shape parameter L can be estimated by 
Eq. 3.16 above. This estimate is different from the 
Original version of the MLG method. 

Substituting this new value for L and bounding the degrees 
of freedom by 1.0, so as not to obtain a negative value, the 
results show a little more improvement. The results 


obtained from this second modification are listed in 


Table V. 


Z2 
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IVs; CONEEUSTONS 


Additional simulations on many more cases would be 
required to determine the particular conditions under which 
this modified log-gamma method is reasonably accurate. For 
the cases examined here the proposed procedure remains 
suspect in estimating lower confidence bounds on system 


reliability. 
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